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Abstract 

Awareness has been shown to be a useful addition to standard epistemic logic for many 
applications. However, standard propositional logics for knowledge and awareness cannot 
express the fact that an agent knows that there are facts of which he is unaware without 
there being an explicit fact that the agent knows he is unaware of. We propose a logic 
for reasoning about knowledge of unawareness, by extending Fagin and Halpern's Logic 
of General Awareness. The logic allows quantification over variables, so that there is a 
formula in the language that can express the fact that "an agent explicitly knows that there 
exists a fact of which he is unaware". Moreover, that formula can be true without the agent 
explicitly knowing that he is unaware of any particular formula. We provide a sound and 
complete axiomatization of the logic, using standard axioms from the literature to capture 
the quantification operator. Finally, we show that the validity problem for the logic is 
recursively enumerable, but not decidable. 
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1 Introduction 



As is well known, standard models of epistemic logic suffer from the logical omniscience prob- 
lem (first observed and named by Hintikka [1962]): agents know all tautologies and all the log- 
ical consequences of their knowledge. This seems inappropriate for resource-bounded agents 
and agents who are unaware of various concepts (and thus do not know logical tautologies 
involving those concepts). Many approaches to avoiding this problem have been suggested. 
One of the best-known is due to Fagin and Halpern [1988] (FH from now on). It involves 
distinguishing explicit knowledge from implicit knowledge, using a syntactic awareness opera- 
tor. Roughly speaking, implicit knowledge is the standard (S5) notion of knowledge; explicit 
knowledge amounts to implicit knowledge and awareness. 

Since this approach was first introduced by FH, there has been a stream of papers on 
awareness in the economics literature (see, for example, [Dekel, Lipman, and Rustichini 1998; 
Halpern 2001; Heifetz, Meier, and Schipper 2003; Modica and Rustichini 1994; Modica and 
Rustichini 1999]). The logics used in these papers cannot express the fact that an agent may 
(explicitly) know that he is unaware of some facts. Indeed, in the language of [Halpern 2001], 
all of these models are special cases of the original awareness model where awareness is gen- 
erated by primitive propositions, that is, an agent is aware of a formula iff the agent is aware 
of all primitive propositions that appear in the formula. If awareness is generated by primitive 
propositions, then it is impossible for an agent to know that he is unaware of a specific fact. 

Nevertheless, knowledge of unawareness comes up often in real-life situations. For ex- 
ample, when a primary physician sends a patient to an expert on oncology, he knows that an 
oncologist is aware of things that could help the patient's treatment of which he is not aware. 
Moreover, the physician is unlikely to know which specific thing he is unaware of that would 
improve the patient's condition (if he knew which one it was, he would not be unaware of it!). 
Similarly, when an investor decides to let his money be managed by an investment fund com- 
pany, he knows the company is aware of more issues involving the financial market than he is 
(and is thus likely to get better results with his money), but again, the investor is unlikely to be 
aware of the specific relevant issues. Ghirardato [2001] pointed out the importance of dealing 
with unawareness and knowledge of unawareness in the context of decision-making, but did 
not give a formal model. 

To model knowledge of unawareness, we extend the syntax of the logic of general aware- 
ness considered by FH to allow for quantification over variables. Thus, we allow formulas 
such as Xi(3x->Aix), which says that agent i (explicitly) knows that there exists a formula of 
which he is not aware. The idea of adding propositional quantification to modal logic is well 
known in the literature (see, for example, [Bull 1969; Engelhardt, Meyden, and Moses 1998; 
Fine 1970; Kaplan 1970; Kripke 1959]). However, as we explain in Section 3, because A,- L is 
a syntactic operator, we are forced to give somewhat nonstandard semantics to the existential 
operator. Nevertheless, we are able to provide a sound and complete axiomatization of the 
resulting logic, using standard axioms from the literature to capture the quantification opera- 
tor. Using the logic, we can easily characterize the knowledge of the relevant agents in all the 
examples we consider. 



2 



The rest of the paper is organized as follows. In Section 2, we review the standard semantics 
for knowledge and awareness. In Section 3, we introduce our logic for reasoning about knowl- 
edge of unawareness. In Section 4 we axiomatize the logic, and in Section 5, we consider the 
complexity of the decision problem for the logic. We conclude in Section 6. 

2 The FH model 

We briefly review the FH Logic of General Awareness here, before generalizing it to allow 
quantification over propositional variables. The syntax of the logic is as follows: given a set 
{1, . . . , n} of agents, formulas are formed by starting with a set $ = {p, q, . . .} of primitive 
propositions, and then closing off under conjunction (A), negation (->), and the modal operators 
Ki, Ai, Xi, i = 1, . . . , n. Call the resulting language £%' X ' A (&). As usual, we define (p Vt/j and 
ip ip as abbreviations of — ■ ( — A and -up V ip, respectively. The intended interpretation 
of Aiip is "i is aware of </?". The power of this approach comes from the flexibility of the notion 
of awareness. For example, "agent % is aware of ip" may be interpreted as "agent % is familiar 
with all primitive propositions in </?" or as "agent % can compute the truth value of ip in time t" . 

Having awareness in the language allows us to distinguish two notions of knowledge: im- 
plicit knowledge and explicit knowledge. Implicit knowledge, denoted by Ki, is defined as 
truth in all states that the agent considers possible, as usual. Explicit knowledge, denoted by 
Xi, is defined as the conjunction of implicit knowledge and awareness. 

We give semantics to formulas in C^' X,A {^) in awareness structures. A tuple M = 
(S, ii, JC\, IC n , A±, . . . , A n ) is an awareness structure for n agents (over $) if S is a set 
of states, 7r : S x $ — > {true, false} is an interpretation that determines which primitive 
propositions are true at each state, /Q is a binary relation on S for each agent % = 1, . . . , n, and 
Ai is a function associating a set of formulas with each state in S, for % = 1, n. Intuitively, if 
(s, t) G /Cj, then agent i considers state t possible at state s, while Ai(s) is the set of formulas 
that agent % is aware of at state s. The set of formulas the agent is aware of can be arbitrary. 
Depending on the interpretation of awareness one has in mind, certain restrictions on Ai may 
apply. (We discuss some interesting restrictions in the next section.) 

Let M. n ($) denote the class of all awareness structures for n agents over <3>, with no restric- 
tions on the /Cj relations and on the functions Ai. We use the superscripts r, e, and t to indicate 
that the /Cj relations are restricted to being reflexive, Euclidean, 1 and transitive, respectively. 
Thus, for example, A / f^*($) is the class of all reflexive and transitive awareness structures for 
n agents. 

We write (M, s) \= (p if y? is true at state s in the awareness structure M. The truth relation 
is defined inductively as follows: 

(M, s) |= p, forp E $, if 7i(s,p) = true 
(M, s) |= -.p if (M, s) ft if 
(M, s) |= tp A ip if (M, s) |= ip and (M, s) \= ip 
1 Recall that a binary relation JCi is Euclidean if (s, t), (s, u) G JCi implies that (t, u) G Ki. 
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(M,s) \=K i( p if (M,t) hv? 

for all t such that (s, t) e /Q 
(M,s) |= A^if G 

(M, s) |= X iV ? if (M, s) \= A iV and (M, s) \= 

A formula (p is said to be valid in awareness structure M, written M \= <p, if (M, s) |= <p 
for all sGS. A formula is valid in a class M of awareness structures, written Af |= </?, if it is 
valid for all awareness structures in Af, that is, if N |= ip for all N e Af. 

Consider the following set of well-known axioms and inference rules: 
Prop. All substitution instances of valid formulas of propositional logic. 

K. (K i( p A Ki((p =S> V)) =*► K^. 
T. K, t ip =>- ip. 

4. K t <p =>• l^X^. 

5. -i-fQv? =>- K^Kiip. 
AO. <^ fQy? A Aj</?. 

MP. From </? and </? =>■ ip infer ^ (modus ponens). 
Gen^. From ip infer .£Q</?. 

It is well known that the axioms T, 4, and 5 correspond to the requirements that the /Q 
relations are reflexive, transitive, and Euclidean, respectively. Let K n be the axiom system 
consisting of the axioms Prop, K and rules MP, and Gen^. The following result is well known 
(see, for example, [Fagin, Halpern, Moses, and Vardi 1995] for proofs). 

Theorem 2.1: Let C be a (possibly empty) subset of {T, 4, 5} and let C be the corresponding 
subset of{r, t, e}. Then K„ U {AO} UC is a sound and complete axiomatization of the language 
C% with respect to M%(&). 

3 A logic for reasoning about knowledge of unawareness 

To allow reasoning about knowledge of unawareness, we extend the language £f-' x ' A ($) by 
adding a countable set of propositional variables X = {x,y, z, . . .} and allowing universal 
quantification over these variables. Thus, if <p is a formula, then so is Vx(p. As usual, we take 
3xip to be an abbreviation for -Nx-np. Let C^' K ' X ' A (^, X) denote this extended language. 

We assume that X is countably infinite for essentially the same reason that the set of vari- 
ables is always taken to be infinite in first-order logic. Without it, we seriously limit the expres- 
sive power of the language. For example, a formula such as 3x3y(->(x y) A A\x A A\y) says 
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that there are two distinct formulas that agent 1 is aware of. We can similarly define formulas 
saying that there are k distinct formulas that agent 1 is aware of. However, to do this we need 
k distinct primitive propositions. 

Essentially as in first-order logic, we can define inductively what it means for a variable x 
to be free in a formula ip. If p does not contain the universal operator V, then every occurrence 
of x in p is free; an occurrence of x is free in -up (or K^ip, X { p, A { p) iff the corresponding oc- 
currence of x is free in (p; an occurrence of x in p>\ A p 2 is free iff the corresponding occurrence 
of x in (fi or p 2 is free; and an occurrence of x is free in \/yp iff the corresponding occurrence 
of x is free in p and x is different from y. Intuitively, an occurrence of a variable is free in a 
formula if it is not bound by a quantifier. A formula that contains no free variables is called a 
sentence. 

Let S% K ' X ' A ($, X) denote the set of sentences in Cl' K ' x ' A ($, X). If ip is a formula, let 
ip[x/ip] denote the formula that results by replacing all free occurrences of the variable x in <p 
by ip. (If there is no free occurrence of x in p, then p[x/ip] = p.) We extend this notion of 
substitution to sequences of variables, writing p>[xi/ipi, . . . , x n /ip n ]. We say that ip is substi- 
tutablefor x in p if, for all propositional variables y, if an occurrence of y is free in ip, then the 
corresponding occurrence of y is free in ip[x/ip]. 

We want to give semantics to formulas in £^' X ' A ($, X) in awareness structures (where 
now we allow Ai(s) to be an arbitrary subset of S^' K ' X ' A (^, X)). The standard approach 
for giving semantics to propositional quantification ([Engelhardt, Meyden, and Moses 1998; 
Kripke 1959; Bull 1969; Kaplan 1970; Fine 1970]) uses semantic valuations, much like in 
first-order logic. A semantic valuation V associates with each propositional variable and state 
a truth value, just as an interpretation it associates with each primitive proposition and state a 
truth value. Then (M, s, V) |= x if V(x) = true and (M, s, V) |= Vxp if (M, s, V) \= p for all 
valuations V that agree with V on all propositional variables other than x. 2 We write V ~ x V 
if V(y) = V'(y) for all variables y ^ x. 

Using semantic valuations does not work in the presence of awareness. If A%(s) consists 
only of sentences, then a formula such as MxAiX is guaranteed to be false since, no matter what 
the valuation is, x £ Ai(s). The valuation plays no role in determining the truth of a formulas 
of the form Ap^>. On the other hand, if we allow Ai(s) to include any formula in the language, 
then (M,s,V) |= VxA^x) iffx e Ai(s). But then it is easy to check that (M, s, V) \= 3xAi(x) 
iff x £ Ai(s), which certainly does not seem to capture our intuition. 

We want to interpret VxA^x) as saying "for all sentences p e S^' K ' X ' A (^, X), A^tp) 
holds". For technical reasons (which we explain shortly), we instead interpret this it as "for 
all formulas p e C^' X ' A (^), Ai{p>) holds". That is, we consider only sentences with no 
quantification. To achieve this, we use syntactic valuations, rather than semantic valuations. 
A syntactic valuation is a function V : X — > which assigns to each variable a 

sentence in 

2 We remark that the standard approach does not use separate propositional variables, but quantifies over prim- 
itive propositions. This makes it unnecessary to use valuations. It is easy to see that the definition we have given 
is equivalent to the standard definition. Using propositional variables is more convenient in our extension. 
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We give semantics to formulas in C^; K ' X ' A (^, X) by by induction on the total number of 
free and bound variables, with a subinduction on the length of the formula. The definitions for 
the constructs that already appear in £%' X ' A (&) are the same. To deal with universal quantifi- 
cation, we just consider all possible replacements of the quantified variable by a sentence in 

• If (p is a formula whose free variables are x 1: . . . , x k , then (M, s, V) \= (p if (M, s, V) |= 

p[x 1 /V(x 1 ), . . .,x k /V(x k )] 

• (M, s, V) |= Vxip if (M, s, V) \= ip for all syntactic valuations V ~ x V. 

Note that although p[xi/V(x 1 ), . . . , V(x k )] may be a longer formula than (p, it involves fewer 
variables, since V(x\), . . . , V(xk) do not mention variables. This is why it is important that 
we quantify only over sentences in C^' X,A (<&); if we were to quantify over all sentences in 
Sn' K ' x ' A (&, X), then the semantics would not be well defined. For example, to determine 
the truth of Vxx, we would have to determine the truth of x[x/Vxx] = Vxx. This circularity 
would make |= undefined. In any case, given our restrictions, it is easy to show that |= is well 
defined. Since the truth of a sentence is independent of a valuation, for a sentence (p, we write 
(M, s) |= ip rather than (M, s, V) \= ip. 

Under our semantics, the formula Ki(3x(AjX A -lAix)) is consistent and that it can be 
true at state s even though there might be no formula ip in £^' X,A ($) such that Ki((Ajip A 
->A i t/j)). This situation can happen if, at all states agent i considers possible, agent j is aware 
of something agent i is not, but there is no one formula ip such that agent j is aware of ip 
in all states agent i considers possible and agent i is not aware of ip in all such states. By 
way of contrast, if 3xKi(Ajx A -<Aix) is true at state s, then there is a formula ip such that 
Ki(Ajip A-i Aiip) holds at s. The difference between Ki3x(AjxA^Aix) and 3xK i (A j xA-'A i x) 
is essentially the same as the difference between 3xKj_(p and Ki(3xp) in first-order modal logic 
(see, for example, [Fagin, Halpern, Moses, and Vardi 1995] for a discussion). 

The next example illustrates how the logic of knowledge of awareness can be used to cap- 
ture some interesting situations. 

Example 3.1: Consider an investor (agent 1) and an investment fund broker (agent 2). Sup- 
pose that we have two facts that are relevant for describing the situation: the NASDAQ index 
is more likely to increase than to decrease tomorrow (p), and Amazon will announce a huge 
increase in earnings tomorrow (q). Let S = {s}, n(s,p) = ir(s,q) = true, /Q = {(s, s)}, 
Ai(s) = {p, 3x(A 2 x A -i^rr)}, and A 2 (s) = {p, q, A 2 q, ~*Aiq, A 2 q A -^Aiq}. Thus, both 
agents explicitly know that the NASDAQ index is more likely to increase than to decrease to- 
morrow. However, the broker also explicitly knows that Amazon will announce a huge increase 
in earnings tomorrow. Furthermore, the broker explicitly knows that he (broker) is aware of 
this fact and the investor is not. On the other hand, the investor explicitly knows that there is 
something that the broker is aware of but he is not. That is, 

(M, s, V) |= X lP A X 2 p A X 2 q A ^X x q 
AX 2 (A 2 q A ^A]_q) A Xi(3x(A 2 x A ^A x x)). 
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Since X 2 (A 2 q A ->Aiq) implies 3xX 2 (A 2 x A -iA-yx), there is some formula x such that the 
broker knows that the investor is unaware of x although he is aware of x. However, since 
(M, s, V) |= ^A 2 (3x(A 2 x A -iAix)), it follows that (M, s, V) |= ^X 2 (3x(A 2 x A -.Aix)). I 

It may seem unreasonable that, in Example 3.1, the broker is aware of the formula A 2 q A 
->Aiq, without being aware of 3x(A 2 x A -<Aix). Of course, if the broker were aware of this 
formula, then X 2 ((3x(A 2 x A -lA-ix)) would hold at state s. This example suggests that we may 
want to require various properties of awareness. Here are some that are relevant in this context: 

• Awareness is closed under existential quantification if ip G Ai(s), <p = ip'[x/ip] and 
i> G C%> then (3xip') G Ms). 

• Awareness is generated by primitive propositions if, for all agents i, ip G Ai(s) iff all the 
primitive propositions that appear in y? are in Ai(s) fl $. That is, an agent is aware of tp 
iff she is aware of all the primitive propositions that appear in (p. 

• Agents know what they are aware of if, for all agents i and all states s, t such that (s,t) G 
/Q we have that Ai(s) = Ai(t). 

Closure under existential quantification does not hold in Example 3.1. It is easy to see 
that it is a consequence of awareness being generated by primitive propositions. As shown 
by Halpern [2001] and Halpern and Rego [2005], a number of standard models of awareness 
in the economics literature (e.g., [Heifetz, Meier, and Schipper 2003; Modica and Rustichini 
1999]) can be viewed as instances of the FH model where awareness is taken to be generated by 
primitive propositions and agents know what they are aware of. While assuming that awareness 
is generated by primitive propositions seems like quite a reasonable assumption if there is no 
existential quantification in the language, it does not seem quite so reasonable in the presence 
of quantification. For example, if awareness is generated by primitive propositions, then the 
formula A,i(3x^Aix) is valid, which does not seem to be reasonable in many applications. For 
some applications it may be more reasonable to instead assume only that awareness is weakly 
generated by primitive propositions. This is the case if, for all states s and agents i, 

• —up G Ai(s) iff (p G Ai(s); 

• ip A if; G Ai(s) iff (p, ip G Ai(s); 

• Kiip g Ai(s) iff (p G Ai(s); 

• A { ip g Ai(s) iff ip g Ai(s); 

• Xi<p g Ai(s) iff (p G Ai(s); 

• if\/x(p G Ai(s), then p G Ai(s) for each primitive proposition p that appears in Vxy?; 

• if ip[x/ip] G Ai(s) for some formula ip G C% ,x ' j4 ($), then 3x<p G Ai(s). 
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If the language does not have quantification, then awareness is weakly generated by primitive 
propositions iff it is generated by primitive propositions. However, with quantification in the 
language, while it is still true that if awareness is generated by primitive propositions then it 
is weakly generated by primitive propositions, the converse does not necessarily hold. For ex- 
ample, if Ai(s) = for all s, then awareness is weakly generated by primitive propositions. 
Intuitively, not being aware of any formulas is consistent with awareness being weakly gen- 
erated by primitive propositions. However, if agent l's awareness is generated by primitive 
propositions, then, for example, 3xAjx must be in Ai(s) for all s and all agents j. 

4 Axiomatization 

In this section, we provide a sound and complete axiomatization of the logic described in the 
previous section. We show that, despite the fact that we have a different language and used a 
different semantics for quantification, essentially the same axioms characterize our definition 
of quantification as those that have been shown to characterize the more traditional definition. 
Indeed, our axiomatization is very similar to the multi-agent version of an axiomatization given 
by Fine [1970] for a variant of his logic where the range of quantification is restricted. 

Consider the following axioms for quantification: 

lv- Vrry? =>- (p[x/tp] if ip is a quantifier- free formula substitutable for x in (p. 

Ky. Vx(<£> =>■ ip) =>■ (Vxy =>■ Wxip). 
Ny. (p =>- \/xip if x is not free in </?. 
Barcan. MxKip =>- K^xp. 
Geny. From tp infer Wxp. 

These axioms are almost identical to the ones considered by Fine [1970], except that we 
restrict l v to quantifier-free formulas; Fine allows arbitrary formulas to be substituted (provided 
that they are substitutable for x). Ky and Gen v are analogues to the axiom K and rule of 
inference Gen^ in K n . The Barcan axiom, which is well-known in first-order modal logic, 
captures the relationship between quantification and Ki. 

Let be the axiom system consisting of the axioms in K„ together with {AO, l v , Ky, N v , 
Barcan, Gen v }. 

Theorem 4.1: Let C be a (possibly empty) subset of {T, 4, 5} and let C be the corresponding 
subset of '{r, t, e}. IfQ is countably infinite, then K^UC is a sound and complete axiomatization 
of the language £^ K ' X ' A (§, X) with respect to M^' c (§, X). 3 

3 We remark that Prior [1956] showed that, in the context of first-order modal logic, the Barcan axiom is not 
needed in the presence of the axioms of S5 (that is T, 4, and 5). The same argument works here. 
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Proof: Showing that a provable formula p is valid can be done by a straightforward induction 
on the length of the proof of p, using the fact that all axioms are valid in the appropriate set of 
models and all inference rules preserve validity. 

In the standard completeness proof for modal logic, a canonical model M c is constructed 
where the states are maximal consistent sets of formulas. It is then shown that if s v is the 
state corresponding to the maximal consistent set V, then (M c , s v ) |= p iff p E V. This will 
not quite work in our logic. We would need to define a canonical valuation function to give 
semantics for formulas containing free variables. We deal with this problem by considering 
states in the canonical model to consist of maximal consistent sets of sentences. There is 
another problem in the presence of quantification since there may be a maximal consistent set 
V of sentences such that -Nxp E V, but ip[x/ip] for all ip E C^' X ' A (^). That is, there is 
no witness to the falsity of \/xp in V. We deal with this problem by restricting to maximal 
consistent sets V that are acceptable in the sense that if -\/xp E V, then -Kp[x/q] E V for 
some primitive proposition q E $. This argument requires $ to be infinite. The details can be 
found in the appendix. | 

To understand why, in general, we need to assume $ is countably infinite, consider the case 
where there is only one agent and $ = {p}. Let p be the formula that essentially forces the S5 
axioms to hold: 

Vx(Kx =>■ KKx) A {^Kx => K^Kx). 

As is well-known, the S5 axioms force every formula in Cf to be equivalent to a depth-one 
formula (i.e., one without nested K's). Thus, it is not hard to show that there exists a finite 
set F of formulas in Ci' X ' A ({p}) such that for all formulas ip with one free variable y and no 
quantification, we have for C C {r, e, t} 

Ml> C (®, X) |= (p A VxAx) (Vt/V & AaeF^[y/^\). 

Thus, if $ has only one primitive proposition, then there are circumstances under which uni- 
versal quantification is equivalent to a finite conjunction. We can construct similar examples 
if $ is an arbitrary finite set of propositions even if there is more than one agent. (In the latter 
case, we add a formula ip' to the antecedent that says that agent 1 knows that all agents have 
the same knowledge that he does: MxKi A™ =2 (KiX K-yx).) Thus, if $ is finite, we would 
need extra axioms to capture the fact universal quantification can sometimes be equivalent to a 
finite conjunction. We remark that this phenomenon of needing additional axioms if $ is finite 
has been observed before in the literature (cf. [Fagin, Halpern, and Vardi 1992; Halpern and 
Lakemeyer 2001]). 

If we make further assumptions about the awareness operator, these can also be captured 
axiomatically. For example, as shown by FH, the assumption that agents know what they are 
aware of corresponds to the axioms 

Aip =^ KiAip and 
-^Aip> K^Aip. 
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It is not hard to check that awareness being generated by primitive propositions can be captured 
by the following axiom: 

A^ip 4=^ A|pg<j) : p occurs in <p}AiP. 

In this axiom, the empty conjunction is taken to be vacuously true, so that Aip is vacuously 
true if no primitive propositions occur in (p. 

We can axiomatize the fact that awareness is weakly generated by primitive propositions 
using the following axioms: 

Al. Ai(ip A ip) <^> Aiip A Aiifj. 

A2. A^ip Aiip. 

A3. AiXjip Ai(p. 

A4. AiAjip Aip. 

A5. AiKjip Aip. 

A6. Ai(p =>- Aip if p e $ occurs in p. 

A7. Aip[x/ip] =>• AiBxp, where ^ e £ T f ,X ' A ($). 

As noted in [Fagin, Halpern, Moses, and Vardi 1995], the first five axioms capture awareness 
generated by primitive propositions in the language £^- ,x ' A ($); we need A6 and A7 to deal 
with quantification. A7 captures the fact that awareness is closed under existential quantifica- 
tion. 

5 Complexity 

Since the logic is axiomatizable, the validity problem is at worst recursively enumerable. As 
the next theorem shows, the validity problem is no better than r.e. 

Theorem 5.1: The problem of deciding if a formula in the language C% K,X ' A (<&, X) is valid in 
A4^(^, X) is r.e. -complete, for all C C {r,t,e} andn > 1. 

Proof: The fact that deciding validity is r.e. follows immediately from Theorem 2.1. For the 
hardness result, we show that, for every formula p in first-order logic over a language with 
a single binary predicate can be translated to a formula p l e C\ ,K ' A (&, X) such that p is 
valid over relational models iff p> 1 is valid in Ai^(^ : X) (and hence in M.^(&, X), for all 
C C {r, t, e}. We leave details of the reduction to the appendix. The result follows from the 
well-known fact that the validity problem for first-order logic with one binary predicate is r.e. 
I 
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Theorem 5.1 is somewhat surprising, since Fine [1970] shows that his logic (which is based 
on S5) is decidable. It turns out that each of the following suffices to get undecidability: (a) the 
presence of the awareness operator, (b) the presence of more than one agent, or (c) not having 
e E C (i.e., not assuming that the /C relation satisfies the Euclidean property). The fact that 
awareness gives undecidability is the content of Theorem 5.1; Theorem 5.2 shows that having 
n > 2 or e ^ C suffices for undecidability as well. On the other hand, Theorem 5.3 shows 
that if n — 1 and e E C, then the problem is decidable. Although, as we have observed, our 
semantics is slightly differently from that of Fine, we believe that corresponding results hold in 
his setting. Thus, he gets decidability because he does not have awareness, restricts to a single 
agent, and considers S5 (as opposed to say, S4). 

Let Cl' K (®, X) consist of all formulas in Cl' K ' x > A ($, X) that do not mention the A { or X { 
operators. 

Theorem 5.2 The problem of deciding if a formula in the language £^' K (§) is valid in 
is re. -complete if 'n > 2 or if e ^ C '. 

Theorem 5.3: The validity problem for the language C\' K ($, X) with respect to the structures 
inM±(§, X)forC D {e} is decidable. 

Interestingly, the role of the Euclidean property in these complexity results mirrors its role 
in complexity for basic epistemic logic without awareness or quantification. As we have 
shown [Halpern and Rego 2006a], the problem of deciding if a formula in the language 
is valid in M%(&) is PSPACE complete if n > 2 or n > 1 and e ^ C; if n = 1 and e G C, it 
is co-NP-complete. 

6 Conclusion 

We have proposed a logic to model agents who are able to reason about their lack of awareness. 
We have shown that such reasoning arises in a number of situations. We have provided a 
complete axiomatization for the logic, and examined the complexity of the validity problem. 

Our original motivation for considering knowledge of unawareness came from game the- 
ory. Notions like Nash equilibrium do not make sense in the presence of lack of awareness. 
Intuitively, a set of strategies is a Nash equilibrium if each agent would continue playing the 
same strategy despite knowing what strategies the other agents are using. But if an agent is not 
aware of the moves available to other agents, then he cannot even contemplate the actions of 
other players. In a companion paper [Halpern and Rego 2006b], we show how to generalize 
the notion of Nash equilibrium so that it applies in the presence of (knowledge of) unaware- 
ness. Feinberg [2004] has already shown that awareness can play a significant role in analyzing 
games. (In particular, he shows that a small probability of an agent not being aware of the pos- 
sibility of defecting in finitely repeated prisoners dilemma can lead to cooperation.) It is not 
hard to show that knowledge of unawareness can have a similarly significant impact. Con- 
sider, for example, a chess game. If we interpret "lack of awareness" as "unable to compute" 
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(cf. [Fagin and Halpern 1988]), then although all players understand in principle all the moves 
that can be made, they are certainly not aware of all consequences of all moves. Such lack 
of awareness has strategic implications. For example, in cases where the opponent is under 
time pressure, experts will make deliberately make moves that lead to positions that are hard 
to analyze. (In our language, these are positions where there is a great deal of unawareness.) 
The logic we have presented here provides an initial step to modeling the reasoning that goes 
on in games with (knowledge of) unawareness. To fully model what is going on, we need to 
capture probability as well as awareness and knowledge. We do not think that there will be any 
intrinsic difficulty in extending our logic to handle probability along the lines of the work in 
[Fagin and Halpern 1994; Fagin, Halpern, and Megiddo 1990], although we have not checked 
the details. 

A Proof of Theorems 

Theorem 4.1: Let C be a (possibly empty) subset of {T, 4, 5} and let C be the corresponding 
subset of {r, t, e}. Then U C is a sound and complete axiomatization of the language 
CY> X ' A (<$>, X) with respect to M v n ' c ($, X). 

Proof: We give the proof only for the case C = 0; the other cases follow using standard 
techniques (see, for example, [Fagin, Halpern, Moses, and Vardi 1995; Hughes and Cress well 
1996]). Showing that a provable formula ip is valid can be done by a straightforward induction 
on the length of the proof of </?, using the fact that all axioms in are valid in _M^ ,0 ($, X) 
and all inference rules preserve validity in .M^' ($, X). 

As we said in the main text, we prove completeness by modifying the standard canonical 
model construction, restricting to acceptable maximal consistent sets of sentences. Thus, the 
first step in the proof is to guarantee that every consistent sentence is included in an acceptable 
maximal consistent set of sentences. 

If q is a primitive proposition, we define (p[q/x] and the notion of x being substitutable for 
q just as we did for the case that q is a propositional variable. 

Lemma A.l: IfiC^ UC \- ip and x is substitutable for q in ip, then U C h Wxip[q/x]. 

Proof: We first show by induction on the length of the proof of (p that if z is a variable that 
does not appear in any formula in the proof of ip, then UC h ip[q/z\. If there is a proof of 
(p of length one, then ip is an instance of an axiom. It is easy to see that ip[q/ z] is an instance 
of the same axiom. (We remark that it is important in the case of axioms Ny and ly that z does 
not occur in (p.) Suppose that the lemma holds for all ip' that have a proof of length no greater 
than k, and suppose that tp has a proof of length k + 1 where z does not occur in any formula of 
the proof. If the last step of the proof of ip is an axiom, then ip is an instance of an axiom, and 
we have already dealt with this case. Otherwise, the last step in the proof of p> is an application 
of either MP, Gen^, or Gen v . We consider these in turn. 
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If MP is applied at the last step, then there exists some <//, such that ip' and ip' =>- p were 
previously proved and, by assumption, z does not occur in any formula of their proof. By the 
induction hypothesis, both p'[q/z] and (</?' =>- p)[q/z\ = p'[q/z] =>- p[q/z] are provable. The 
result now follows by an application of MP. 

The argument for Gen K and Gen v is essentially identical, so we consider them together. 
Suppose that Gen K (resp., Gen v ) is applied at the last step. Then p has the form K^p' (resp., 
\/yp') and there is a proof of length at most k for p>' where z does not occur in any formula in 
the proof. Thus, by the induction hypothesis, p'[q/z] is provable. By applying Gen K (resp., 
Geny), it immediately follows that <p[q/z] is provable. 

This completes the proof that p> [q/z] is provable. By applying Gen v , it follows thatV zp[q/ z] 
is provable. Since x is substitutable for q in p, x must be substitutable for z in p[q/z\. Thus, 
by applying the axiom l v and MP, we can prove p[q/x\. The fact that \/xp[q/x\ is provable 
now follows from Gen v . I 

Lemma A.2: Every K^-consistent sentence p is contained in some acceptable maximal In- 
consistent set of sentences. 

Proof: We first show that if A is a finite K^-consistent set of sentences, -Nxip € A, and 
q is a primitive proposition that does not appear in any sentence in A, then A U ->p[x/q] is 
K^-consistent. Suppose not. Then there exist sentences fa, . . . , fa e A such that 

Klh(ftA...Aft)^#/?]. 

By Lemma A. 1 , we have 

K^V^A.-.A^^^). (1) 

Now applying K v and N v , and using the fact that x is not free m.fat\.../\fa (since fa, ... ,fa 
are sentences), it easily follows that 

K V n h(AA...AA)4 Va^. 

Since fa, . . . , fa, -Nxip e A, this contradicts the assumption that A is K^-consistent. 

We now use standard techniques to construct an acceptable maximal K^-consistent set of 
sentences containing p. Consider an enumeration {ipi,ip2, . . .} of the sentences in S^' K ' X ' A . 

We construct a sequence of K^-consistent sets of sentences A , Ai, Let A = {p}. For 

all k > 1, if A k -i U {ipk} is not K^-consistent, A k = A fc _i. If A k -i U {ipk} is K^-consistent, 
if ipk is not of the form -Nyip', then A^ = Ak-\ U {ipk], while if ipk is of the form -Nyip', then 
Ak = Ak-i U {ipk, ^'[y/q]} for some q E $ not occurring in Ak-i U {ipk}- By our earlier 
argument, it easily follows that each set A k is K^-consistent. Let A be the union of the A n 's. 
It is easy to see that A is an acceptable maximal K^-consistent set of sentences that contains 
p. I 

For a set T of formulas, define Y/Ki = {ip : Kiip e Y}. 
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Lemma A.3: If Y is a K.^-consistent set of sentences containing ->Kiip, then Y/Ki U {^} is 
K^-consistent. 

Proof: This is a standard modal logic argument; see, for example, [Hughes and Cresswell 
1996, Lemma 6.4]. We omit details here. | 

Lemma A.4: IfY is an acceptable maximal K^-consistent set of sentences and ->Ki(p G Y, 
then there exists an acceptable maximal K^-consistent set of sentences A such that (Y/Ki U 
W)CA. 

Proof: We first show that if Y/K U {71, . . . , 7„, -Wxip} is a K^-consistent set of sentences, 
then there exists some q G $ such that Y/Ki U {71, . . . , 7„, -Nxij), - , ip[x/q]} is K^-consistent. 
For suppose not. Then, for all q, there must exist fa, . . . , fa G Y/Ki such that 

K*h (ft A... A 00 ^(7^ 
where 7 = 72 A . . . A 7„ A -iVxip. By Gen^, we have that 

h A ... A fa) =>• (7 =>• ^[x/g])). 

Applying axiom K, and using the fact that if A ... A /3 fc ) G T and T is maximal, we 
have that if* (7 =>- ip[x/q\) G T for all q. Since T is acceptable, it must be the case that 
\/xKi(^j =^> tp) G T. By the Barcan axiom, it follows that K/ix(^j =>- ip) G T. Since 7 is a 
sentence, applying K v , N v , K, and Gen^-, it follows that K-ix(^ =>- ip) =>- if* (7 =>- Vrn/>) is 
provable in K^. Hence, iQ(7 =>• Vx^O G T. Thus, 7 =>- Vxip G r/iQ. But this contradicts the 
consistency of Y/K U {71, . • • , 7„, -iVxip}. 

We now proceed much as in the proof of Lemma A. 2. Given an enumeration ip±, ip 2 , ■ ■ ■ 
of the sentences in S^' K ' X ' A , we construct a sequence of K^-consistent sets of sentences 

A , Ai, LetA = V/KiU{-np}. (Note that Lemma A.3 implies that A is K^-consistent.) 

For all k > 1, if A fc _ x U {ip k } is not K^-consistent, A k = A fc _i. If A fc _i U {ip k } is K^- 
consistent, if ip k is not of the form -iVyip', then A k = A fe _i U {ip k }, while if *0 fe is of the form 
-^Vyip', then A k = A k ^ U {^ k , -v//[y/q]} for some g G $ such that A fc _! U {^ fc , ^ip'[y/q\} 
is consistent. (Such a q exists by our earlier argument.) It is easy to see that A = U n A n is the 
desired acceptable maximal K^-consistent set of sentences. | 

We are now able to prove the following key lemma. 

Lemma A.5: Ifip is a ¥? n -consistent sentence, then ip is satisfiable in M.^' 9 ^, X). 

Proof: Let M c = (S, JC 1: /C„, A\, . . . , A n , 7r) be a canonical awareness structure con- 
structed as follows 

• S — {s v : V is an acceptable maximal K^-consistent set of sentences}; 



14 




• Ai(s v ) = W ■ A W e V}; 



• lQ(sv) = {s w ■ V/Ki C W}. 



We show as usual that if ^ is a sentence, then 



(M C , Sy) |= ip iff V e V. 



(2) 



Note that this claim suffices to prove Lemma A. 5 since, if (p is a K^-consistent sentence, by 
Lemma A. 2, it is contained in an acceptable maximal K^-consistent set of sentences. 

We prove (2) by induction of the depth of nesting of V, with a subinduction on the length 
of the sentence. 

The base case is if ip is a primitive proposition, in which case (2) follows immediately from 
the definition of it. For the inductive step, given ip, suppose that (2) holds for all formulas ip' 
such that either the depth of nesting for V in ip' is less than that in ip, or the depth of nesting is 
the same, and ip' is shorter than ip. We proceed by cases on the form of ip. 

• If ip has the form ->ip' or ipi A ip 2 , then the result follows easily from the inductive 



• If ip has the form Aiip', then note that ip' is a sentence and (M c , sy) |= Aiip' iff ip' G 
Ai(s v ) iff Aiip' e V. 

• If ip has the form Kiip', then if ip G V, then ip' EW for every W such that sw G /Cj(sy). 
By the induction hypothesis, (M c , sw) |= ^' for every s w G /Q(sy), so (M c , sy) |= 
i^iV'- If V' ^ ^ then -up G V since V is a maximal K^-consistent set. By Lemma 
A.4, there exists an acceptable maximal K^-consistent set of sentences W such that 



(V/Ki U {-<}) C By the induction hypothesis, (M c , s w ) tf= ip'. Thus, (M c , sy) tf= 
KiiP'. 



• If ip has the form X^', the argument is immediate from the preceding two cases and the 
observation that (M, sy) \= Xtf iff both (M, s v ) |= Kiip' and (M, sy) |= A'^, while 
X^' G V iff both X^' G V and A$ G V. 

• Finally, suppose that ip = \/xip'. If ip G V then, by axiom l v , V^/V] e ^ f° r ai l V 9 e 
£^ r ' x,A ( ( l ) ). The depth of nesting of ip'[x/ip\ is less than that of \/xip', so by the induction 
hypothesis (M,s v ) \= ip'[x/(p] for all p G £%> X ' A {$). By definition, (M, sy) \= ip, 
as desired. If ip £ V then, since V is acceptable, there exists a primitive proposition 
g G $ such that ip'[x/q] £ V. By the induction hypothesis, (M c , sy) \£ ip'[x/q]. Thus, 
(M c , sy) ^ ^, as desired. 



hypothesis. 
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To finish the completeness proof, suppose that p is valid in _A/f^ ,0 ($, X). Then, consider 
two cases: (1) p is a sentence, and (2) p is not a sentence. If (1), then -xp is a sentence and 
is not satisfiable in X). So, by Lemma A. 5, -up is not K^-consistent. Thus, p is 

provable in K^. If (2) and {xi, . . . , Xk} is the set of free variables in p, then Vxi . . . Va^y? is a 
valid sentence. Thus, by case (1), \/xi . . . ^XkP is provable in K^. Applying ly repeatedly it 
follows that (p is provable in K^, as desired. | 

Theorem 5.1: Deciding if a formula in the language C^ K,X ' A (^, X) is valid in X) is 

r.e. -complete, for all C C {r, t, e} and n > 1. 

Proof: The fact that deciding validity is r.e. follows immediately from Theorem 2.1. For the 
hardness result, to do the reduction, we first fix some notation. Take an R-formula to be a first- 
order formula (without equality) whose only nonlogical symbol is the binary predicate R. Take 
an R-model to be a relational structure which provides an interpretation for R. A countable 
R model is an R model with a countable domain. It is well known that the satisfiability prob- 
lem for R- formulas is undecidable [Lewis 1979]. Thus, it suffices to reduce the satisfiability 
problem for i?-formulas to the satisfiability problem for formulas in C^' K ' X ' A (^, X). 

For easy of exposition, assume that the set $ of primitive propositions includes q±, q 2 , and 
r; later we show how to get rid of this assumption. Given an i?-model N, we will construct 
an awareness structure M that represents N. Roughly speaking, a state in M represents an 
ordered pair of domain elements in N. The primitive proposition r will be true at a state s in 
M iff R(di, d 2 ) is true in N of the pair (d± : d 2 ) represented by s. The primitive propositions q± 
and q 2 are used to encode di and d 2 . Let a be the awareness formula that, roughly speaking, 
forces it to be the case that for all states s, if r is true at some state t that represents (d 1: d 2 ) 
such that (s, t) e /C, then r is true at all states t' that represent (d 1: d 2 ) such that (s, t') G /C. (It 
follows that if ->r is true at some state t that represents (d±, d 2 ) such that (s, t) € /C, then -ir is 
true at all states t' that represent (d\, d 2 ) such that (s, t') G /C. The formula a is 

Vx 1 Va; 2 (^ir^(A(a; 1 A 9l ) A A[x 2 A g 2 ) Ar) 4 K((A( Xl A 9l ) A A(x 2 A q 2 )) r)). 

Now we translate an i?- formula ip to an awareness formula ip*. We consider only /^-formulas 
formulas in negation normal form, i.e., formulas ip that use A, V, V, and 3, where the negation 
has been pushed in so that it occurs only in front of the predicate R. It is well known that every 
i?-formula is equivalent to a formula in negation normal form. 

• (R(x, y)Y = -iK-i(r A A(x A q x ) A A(y A q 2 )) 

• {^R{x, y)Y = ^K^r A A(x A q ± ) A A(y A q 2 )) 

• ((fi A p 2 y = p\ A p\ 

• ((pi V p> 2 y = p\ V y? 2 
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• (3xipY = 3xip t 

We say that an awareness structure M = (S, /C, A, ir) is universal ifJC — SxS. It is easy 
to see that if M is a universal structure, then M G .Mf ($, Af) for all C C {r, t, e}. Moreover, 
an easy argument by induction on structure, whose proof we leave to the reader, shows the 
following. 

Lemma A.6: If M = (S, . . .) is a universal structure, then for all R-formulas in nega- 
tion normal form and V is a syntactic valuation, then (M, s, V) |= ■0* f or some s G S iff 
(M, s', V) |= i> 1 for all states s' G S. 

We write (M, V) |= ^ if (M, s, V) |= ^ for all s G S. 
Theorem 5.1 follows from the following claim: 

For all C C {r, t, e}, is satisfiable in an i?-model iff ip* A a is satisfiable in A^f ($, A'). 

(3) 

To prove (3), first suppose that ip is a satisfiable i?-formula. It is well known that an R- 
formula is satisfiable iff it is satisfiable in a countable i?-model [Enderton 1972] (that is, an R- 
model with a countable domain. (Of course, this result holds for arbitrary first-order formulas, 
not just i?-formulas.) Thus, we can assume without loss of generality that ip is satisfied in the 
R- model N with countable domain D N . 

Let L be a surjection from C^' X ' A (^) to D N . (Since D N is countable, such a surjection 
exists.) Given the i?-model iV with countable domain D N , define M N = (S, /C, A, ir) to be the 
universal awareness structure such that 

• S= {(d u d 2 ) : d u d 2 G D N }; 

• 7r((di, d 2 ),r) = true iff (di, d 2 ) G R; 

• 7r((di, d 2 ), q) = true for all q G $ — {r}; 

• ^((dx, d 2 )) = A Ql : L(^) = di} U A g 2 : L(^) = d 2 }. 

It is easy to check that |= a; we leave the proof to the reader. Thus, it suffices to show 
that there is some state s and syntactic valuation V such that (M N , s, V) \= </?*. This follows 
from the following result. 

Lemma A.7: For every first-order formula ip in negation normal form, if N |= ip then |= 
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Proof: We actually prove a slightly more general result. A syntactic valuation V is L-compatible 
with a valuation V on N (that is, a function mapping variables to elements of D N ) if, for all 
variables x, L(V(x)) = V(x). We show that for all first-order formulas ip (not necessarily a 
sentence) and all valuations V on JV, if (JV, V) \= ip, then (M N , V) |= ip* for all syntactic 
valuations V L-compatible with V. The proof is by induction on structure. 

Suppose that ip = R(x,y). Then, (JV, V) \= ip iff s = (V(x), V(y)) G R. By definition, 
s G R iff 7r(s, r) = true and (Mat, s, V) |= A(rr Agi) A A(y /\q 2 ) for all syntactic valuations V 
L-compatible with V. Since 7lLv is universal and R(x, y) 1 = ->K-i{r A A(x A gi) A A(y A 52)), 
it follows that (Mat, V) |= R(x, y) 1 for all V L-compatible with V . A similar argument applies 
if ip is of the form ->R(x, y). If ip = ipi A ip 2 or ■?/> = ^1 V the result follows easily from the 
induction hypothesis. Suppose that ip = \/xip', (JV, V) \= Vxip', and V is L-compatible with 
V. We want to show that (M N , V) |= ip*. Since ip* = Vx(ip')*, we must show that (M N , V) \= 
(ip')* for all V ~a; V. Given a valuation V' ~ x V, consider the valuation V' = Lo V' on JV; that 
is, V'(y) = L(V(y)) for all variables y. Clearly, if y ^ x, V'(y) = L(V'(y)) = L(V(y)) = 
V(y). Thus, V ~ x V, so (JV, V) \= ip'. Moreover, since V is clearly L-compatible with V, 
it follows from the induction hypothesis that (M N , V) \= (ip')*. Hence, (M N , V) |= Vx(ip')*, 
as desired. Finally, suppose that ip = 3xip', (JV, V) |= ip, and V is L-compatible with V. We 
want to show that (M/v, V) |= ip*. Since (JV, V) |= 3xip', there must exist some valuation 
V ~ x V such that (JV, V') |= ■*/>'. By the induction hypothesis, for all V" L-compatible with 
V, we have (M N) V") |= (ip 1 )*. Choose some formula ip' G L _1 (y (#)) (such a ip' exists since 
L is a surjection). Define V by taking V'(y) = V(y) fory^x and V'(x) = <//. Clearly 
V' is L-compatible with V. Thus, (Mjv, V) |= (ip')*, by the induction hypothesis. Hence, 
(M N , V) |= 3x(ip')*. This completes the induction proof . | 

We have now proved one direction of (3): for all C C {r, t, e}, if is satisfiable in some 
i?-model, then (p* A a is satisfiable in some structure in A^^($, X). For the converse, suppose 
thatv?* Act is satisfiable in some structure M = (S, JC, A, n) inXf ($, X). If (M, s) |= y?' Act, 
then define an i?-model N M )S whose domain D M s = £f r ' x,A ($) and _R M ' S (the interpretation 
of R in JVm,s) is {(■?/>, ip') '■ vr(t, r) = true for all t such that (s, t) G /C, ip A 51 G -4(t), and 
■0' A g 2 G Note that because the domain on JV M s is £f r,x ' j4 ( ( l ) ), a syntactic valuation is 

also a valuation on JV M s . The other direction of (3) follows immediately from the following 
result. 

Lemma A.8: For all formulas ip in negation normal form and all syntactic valuations V, if 

(M, s, V) |= ip* A a then (JV M)S , V) |= ip. 

Proof: We prove the lemma by induction on the length of ip. If ip — R(x, y) and (M, s, V) |= 
ip* A a, then that there exists t such that (s,t) G /C, n(t,r) = true, V(x) A q\ G »4(i), and 
V(y) A q 2 G ^l(t). Since a implies that for all t' such that (s, t') G /C, V(x) A gi G ^t(t') and 
V(y) A g 2 G »4(t'), it must be the case that n(t',r) = true. Thus, by definition of R M ' S , it 
follows that (V(x),V(y)) G R M ' S . Therefore, (JV M , S , V) |= ^. A similar argument applies if 
■0 is of the form ->R(x : y). If ip = ip\ A ^ 2 or i> = i>\ V ^2, the result follows easily from 
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the induction hypothesis. If tp — \/xip' and (M, s, V) \= ^ A cr, then, since a is a sentence, 
for all V ~ x V, we have (M, s, V) |= (ip'Y A cr. By the induction hypothesis, it follows 
that (N M ,8, V) h ^' for a11 V such that V ~ x V. Since L> n = Cf ,X ' A ($), it follows that 
(N M , S , V) |= Vx^'. Finally, suppose that *0 = zb*0' and (M, s, V) |= A cr. Again, since cr 
is a sentence, there exists some V ~ x V such that (M, s, V) \= (ip'Y A cr. By the induction 
hypothesis, it follows that (N M:S , V') |= ip'. Thus, (N MjS , V) |= Elx^', as desired. | 

This completes the proof of (3) and Theorem 5.1. Note that exactly the same proof works 
if we take q 2 = ->qi and r = q x . Therefore, the assumption that $ includes qi, q 2 and r can be 
made without loss of generality. | 

Theorem 5.2: The problem of deciding if a formula in the language is valid in M^iffe) 
is re. -complete if 'n > 2 or if e C '. 

Proof: The fact that deciding validity is r.e. in all these cases follows immediately from 
Theorem 2.1. 

To prove hardness, we start with the case that e E C and n — 2. For ease of exposition, 
we assume that $ is countably infinite. We show at the end of the proof how to remove this 
assumption. Let an R-formula, an R-model, and an countable R model be as defined in the 
proof of Theorem 5.1. Again, it suffices to reduce the satisfiability problem for i?-formulas to 
the satisfiability problem for formulas in £^(<3>, X). 

Assume that $ contains the primitive propositions p, q, and r. Our goal is to write a modal 
formula that forces a model to have four types of states: 

• States satisfying ->p A ->q. Intuitively, these states will represent pairs (d 1 , d 2 ) of domain 
elements in an i?-model. 

• States satisfying p A -<q. Intuitively, these states represent the first element d\ in a pair 

(di,d 2 ). 

• States satisfying ->p A q. Intuitively, these states represent the second element d 2 in a pair 

(di,d 2 ). 

• States satisfying p A q. Intuitively, these states represent domain elements. 

We want it to be the case that the states satisfying ->p A -<q form a JCi equivalence class; for 
each state satisfying ->p A -19, there is a /C 2 -edge going to a state satisfying p A -<q and one 
going to a state satisfying -ip A q. Intuitively, this triple of states represents a pair (di, d 2 ), 
the first component of the pair, and the second component of the pair. Finally, from each state 
satisfying p A ->q or ->p A q, there is a /Ci-edge to a state satisfying p A q; the latter state is the 
one that determines the domain element. Finally, the primitive proposition r is true at a state 
satisfying -ip A ->q iff R(d±, d 2 ) holds in the i?-model. (We remark that this construction is 
somewhat similar in spirit to a construction used by Engelhardt, van der Meyden, and Moses 
[2005] to prove that, in the case of semantic valuations, the validity problem is II 2 - complete.) 
Figure 1 describes the desired situation: 
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Figure 1: States. 



In the figure, the JCi relation consists of the pairs joined by dotted lines; the /C 2 consists of 
the pairs liked by the continuous edges. (In both cases we omit self-loops.) 

Let atomic(x) be an abbreviation for the formula 

-iKxKiKx-iip Aq Ax) A Sy^K^K^x Ay) A ^K x K 2 K x -^{x A -y)). 

Intuitively, atomic(x) is true if all K\K 2 K\ -reachable worlds that satisfy x agree on all sen- 
tences. We use worlds where pAqAx holds for some atomic formula x to represent elements in 
d. If two worlds satisfy the same atomic formula, then they represent the same domain element. 

Let <7i be the modal formula that forces the set of atomic formulas to be non-empty. o\ is 
an abbreviation for 3x ( atomic (x)). 

Let o"2 be the modal formula that, roughly speaking, forces it to be the case that if r is true 
at some state t that represents (di, d 2 ) (i.e., a state where -ip A ->q is true), then r is true at 
all states t' that represent (d-y, d 2 ). (It follows that if ->r is true at some state t that represents 
(di, d 2 ), then ->r is true at all states t' that represent (d± : d 2 ).) The formula 2 is an abbreviation 
for 

WxVy((atomic(x) A atomic(y)A 

-iKi-i(r A-ipA-iqA ~^K 2 ^(p A ->q A -iKi-i(p Aq Ax)) A ~^K 2 ^(^p Aq A -^K x ^(p Aq Ay) 
=>- Ki(-ip A ->q A ~^K 2 ^(p A ->q A -iKi~i(p Aq Ax)) A ~^K 2 ^(^p Aq A -iKi~i(p A q A y)) =>• 

Let = 0i A 2 . 

We now translate an R- formula ip to an awareness formula ip 1 . We consider only R- 
formulas formulas in negation normal form. 

• (R(x,y)Y = atomic(x) A atomic(y) A -ii^-i(r A ->p A ->q A ~^K 2 ^(p A ->q A ->K t ->(p A 
q A x)) A -.^-.(-.p A q A ^K^(p A q A y)))\ 

• (-iR(x,y)Y = atomic(x)Aatomic(y)A^K 1 ^(^rA^pA^qA^K2^(pA^qA^K 1 ^(pA 
q A x)) A ->K 2 ->(->p A q A A q A y))); 

• (<fi A <p 2 y = <p{ A ipi; 
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• (<pi v <p 2 y = <p\ v lp\\ 

• (WxtpY = Wx(atomic(x) =>- ip t ); 

• (3xipY = 3x(atomic(x) A </?*). 

Theorem 5.2 in the case that C D {e} follows from the following claim: If e G C and 
n > 2, then 

For every /^-sentence ip, ip is satisfiable in an i?-model iff ip* A a is satisfiable in .A/l^($, Af). 

(4) 

To prove (4), first suppose that ip is a satisfiable /^-sentence. As in Theorem 5.1, we can 
assume without loss of generality that ip is satisfied in an _R-model N with countable domain 
D N . Let L be a surjection from $ — {p, g, r} to Djy. (Since Z)jv is countable and $ is countably 
infinite, by assumption, such a surjection exists.) Define M N = (S, IC 1 , /C 2 , 7r) to be the Kripke 
structure such that 

• S = D N U (D N x Uf =1 {(dx, d 2 , i):d 1 ,d 2 e D N }; 

• 7r(s, r) = true iff (di, d 2 ) £ -R, and s = (di, d 2 ); 

• 7r(s,p) = true iff either s G -Djv or s is of the form (di, d 2 , 1) for some d 1 , d 2 G -Djv; 

• 7r(s, g) = true iff either s G -Djv or s is of the form (d 1: d 2 , 2) for some d 1: d 2 G -Djv; 

• for allp' G $ — {p, q, r}, n(s,p') = true iff L(p') = d and s = d; 

• /Ci(s) = (D N x Djy) for s G (Av x Av), and /Ci((di, d 2 , 1)) = ^i((d 2 ,di,2)) = 
^i(^i) = ^2, 1), (4, di, 2), di} for d\,d 2 G £V; 

• }C 2 ((d 1: d 2 )) = IC 2 ((d u d 2 ,l)) = ^((^,^,2)) = {(d 1 ,d 2 ),(d 1 ,d 2 ,l),(d 1 ,d 2 ,2)}for 
di, d 2 G -Dat, and /C 2 (d) = {d} for d G Ay. 

It is easy to check that M N G M 2 e,t ($, X) (and hence also in M%($, X) for all C such 
that e G C) and that (Mjy, (di, d 2 )) |= cr for all (di, d 2 ) G -Dat x D n (note that a is a sentence 
and therefore is independent of the valuation); we leave the proof to the reader. Thus, it suffices 
to show that there exists a state s* G D N x D N such that (M N) s*) |= ip*. This follows from 
the following result. 

Lemma A.9: If s* G D N x D N , then for every first-order sentence ip in negation normal form, 
ifN \= $ then (M N , s*) \= ip\ 

Proof: Fix s* G Dn x Dn. We actually prove a slightly more general result. A syntactic 
valuation V is M N -compatible with a valuation VoniV if, for all variables x and all s e S, 
(M N , s, V) |= x iff s = V(x). We show that for all first-order formulas ip (not just sentences) 
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and all valuations V on JV, if (JV, V) \= ip, then {M N , s*, V) |= ip* for all syntactic valuations 

V M7v-compatible with V. The proof is by induction on structure. 

Suppose that^ = R{x,y). Then, (JV, V) \= ip iff (V(x), V{y)) G R. By definition of 
7r, if (V(x), V(y)) G R then 7r((V'(a;), v(y)), r) = true. Let V be a syntactic valuation M N - 
compatible with V. By definition, (M N) s 1? V) |= x iff si = V(a;) and (Mjv, s 2 , V) |= y iff 
S2 = Thus, by definition of M N , it is easy to see that (M N ,s*,V) |= atomic(x) A 

atomic(y). By definition of /Ci and 7r, we have (M N , (V(x), V{y), 1), V) |= ->Ki-i(p Aq Ax) 
and (Mjv, (V(ar), V(j/), 2), V) |= ^K^{p A q Ay). By definition of /C 2 and tt, it follows that 
(M^, (V (x), V(y)), V) h r A ~^p A ->q A ~^K 2 -<{p A->q A ^K x ^{p A q A x)) A ~^K 2 ^p A 
qA-iK^ipAqAy)). Since (V(x),V(y)) G /Ci(s*), (M N ,s*,V) |= atomic(x) A atomic(y), 
and y))* = atomic(x) A atomic(y) A ->K 1 ->(r A -<p A ->q A ~^K 2 ^{p A~>qA ->K 1 ->{p A 
q Ax)) A -iK 2 -i(-ip A ?A-.iT n (pA q A y))), it follows that (M N , s*, V) \= R(x, y)* for all 

V M w -compatible with V. A similar argument applies if ip is of the form -*R{x, y). 

If ip = fa A ip 2 or ip = ipi V ip 2 , the result follows easily from the induction hypothesis. 

Suppose that ip = 3xip', (JV, V) |= ip, and V is M^-compatible with V. We want to show 
that (M N , s*, V) |= ■0*- Since (JV, V) |= Eta^', there must exist some valuation V ~ x V such 
that (JV, V) |= ■*/>'• By the induction hypothesis, for all V" M^-compatible with V, we have 
(M^, s*,V") |= (V'')*- Choose some primitive proposition p' G L _1 (y(a;)) (such a p' exists 
since L is a surjection). Define V' by taking V'(y) = V(y) for y ^ x and V'(x) = p'. Clearly 

V is Mjv-compatible with V. Thus, by the induction hypothesis, (M N , s*, V) |= {ip')*. Since 
{M N ,s*,V) (= atomic(x), we have (Mat,s*,V) |= Ete( atomic (x) A (?//)*) for all V Mjv- 
compatible with V. 

Finally, suppose that ip = \/xip', (JV, V) |= Vxip', and V is MAr-compatible with V. We 
want to show that {M N) s*, V) \= ip*. Since ip* = ^x{atomic{x) =>- {ip')*), we must show that 
{M N , s*, V) \= {atomic{x) {ip'Y) for all V' ~ s V. Given a valuation V' ~ x V, suppose that 
(M^, s*, V) \= atomic{x). It follows that there is a unique t G Dn such that (Mat, t, V) |= x. 
Let V be the valuation such that V ~ x V and V'(x) = £. Since V is M N -compatible with 
V, it can be easily shown that V' MAr-compatible with V. It thus follows from the induction 
hypothesis that {M N , s*,V) |= {ip')*. Hence, (Mat,s*,V) |= ^x{atomic{x) {ip'Y), as 
desired. This completes the induction proof. | 

To prove the other direction of (4), suppose that ip* A a is satisfiable in some structure 
M = (S,/Ci,/C 2 ,7r) G M&<S>,X). If (M,s,V) |= y?* A a, then define an J?-model JV M)S 
whose domain Dm, s = {<f G ^ 2 Y ($) : (M, s) |= atomic{(p)} and i? M,s (the interpretation of 
i? in N M , S ) is {(0,^0 : 7r(t, r) = true for all t such that (s,t) G /C, (M,t) |= ->p A ->q A 
^K 2 ^{p A->q A ~^Ki^{p A q Aip)) A ^K 2 ^{^p Aq A ^K^{p A q A ip')). Define V to be 
D M ^-compatible with V if V{x) G Dm, s implies that V{x) = V(x). The other direction of (4) 
follows immediately from the following result. 

Lemma A. 10: For all formulas ip in negation normal form and all syntactic valuations V, if 
(M, s, V) |= ip 1 A a then {N M ^ S , V) \= ip for all V D M s -compatible with V. 
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Proof: We prove the lemma by induction on the structure of ip. If ip = R(x, y) and (M, s, V) |= 
ip* A <7, then (M, s, V) |= atomic(x) A atomic(y) and there exists i such that (s, £) E /Ci and 
(M, t, V) |= r A->pA->qA->K 2 -'{pA->qA-<K 1 ->{pAqAx)) A^K 2 ^(^pAqA^K 1 ^(pAqAy)). 
Since a implies that for all t' such that (s, i') E fCi and (M, t', V) |= -*pA-*qA ^K 2 ^(p A->qA 
~^Ki^(p Aq Ax)) A^K 2 ^(-^p Aq A^K\^(p Aq Ay)),\i must be the case that ir(t',r) = true. 
Thus, by definition of R M > S , it follows that (V(x), V(y)) E R M > S . Since V{x), V(y) E D M , S , 
(V(x),V(y)) E R M ' S for all V /^-compatible with V. Therefore, (N MjS ,V) |= ip for 
all V _D Ms -compatible with V. A similar argument applies if ip is of the form -*R(x,y). If 
ip = ipi A ip 2 or ip = ipi V the result follows easily from the induction hypothesis. 

Suppose that ip = \/xip' and (M, s, V) |= a A ip*. Since ip* = \/x(atomic(x) =>- (ip'Y) 
and a is a sentence, for all V' ~ s V, we have (M, s, V') |= cr A (atomic(x) =>- (VO*)- I n 
particular, for all V ~ x V such that (M, s, V) |= atomic(x), we have (M, s, V) |= (>')*• B Y 
the induction hypothesis, it follows that (N MjS , V) |= ip' for all V D M s -compatible with V. 
Suppose that V is D M s -compatible with V. We want to show that (N M>S , V) |= \/xip'. Consider 
any V ~ x V. Let V" be the syntactic valuation such that V" ~ x V and V"(x) = V'(x). Clearly 
V is /^-compatible with V". Since V" ~ s V, (M, s, V") |= atomic(x), and V is D M;S - 
compatible with V", the induction hypothesis implies that (N M , S , V) \= ip'. It follows that 
(N M , S , V) |= ip'. Therefore, (N M , S , V) \= Vxip', as desired. 

Finally, suppose that ip = 3xip' and (M, s, V) |= ip* Aa. Since ■0* = 3x(atomic(x) A (ip')*) 
and o" is a sentence, there exists some V ~ x V such that (M, s, V') \= a A atomic(x) A (ip'Y- 
By the induction hypothesis, it follows that (N M , S , V) \= ip' for all V _DM,s-compatible with 
V. Let V be _DM,s-compatible with V. Let V" be the valuation such that V" ~ x V and 
^"(a;) = V'(x). Clearly V" is _DM,s-compatible with V' . Thus, by the induction hypothesis, 
(N M ,a, V") f= Since V" ~ s V, it follows that (7V M;S , 1/) |= 3a^', as desired. | 

This completes the proof of Theorem 5.2 in the case that e E C. We next briefly describe 
the changes necessary to deal with the case that e ^ C. 

Let atomic'(x) (resp., a[, a' 2 , a', and ip T ) be the result of replacing every occurrence of 
K 2 in atomic(x) (resp., o\, a 2 , a, and ip*) by K\. (Of course, if t E C, then the K 1 KiK 1 in 
atomic(x) can be simplified to K^) We now show that (4) holds if C C {r,t} and n > 1. 
For the forward direction, if ip is satisfiable in an /?-model iV with a countable domain D N , we 
construct a structure M' N = (S, IC[, it), where S and 7r are just as in the construction of M N 
and JC[ is given by 

• /Ci((di, 4)) = -DjvX-DivU{(<ii, d 2 , 1), (rfi, d 2 , 2), d b d 2 }, /Ci((di, d 2 , 1)) = d 2 , 1), d ± }, 
/Ci((di, d 2 , 2)) = {(dj, d 2 , 2), d 2 }, /Ci(di) = {di} for di,d 2 E D N ; 

It is easy to check that e A4i'*($, Af) (and hence also in M% ($, Af) for all C such that 
e ^ C) and that (M^, (g^, d 2 )) H °" f° r ai l d 2 ) E D N x D N ; we leave the proof to the 
reader. We also leave it to the reader to check that the analogue of Lemma A. 9 holds. For 
the converse, if ip T A a' is satisfiable in a Kripke structure M E Mi, we construct an R- 
model satisfying ip using essentially the same construction as above, except that in defining 
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the interpretation of R, we replace every occurrence of K 2 by K x . We leave it to the reader to 
show that the analogue of Lemma A. 10 holds. 

Up to now we have assumed that $ is infinite. However, we can apply the techniques 
of [Halpern 1995] to show that undecidability holds in all cases even if |$| = 1. Suppose 
that p* £ $. We briefly sketch the argument in the case that e G C. Let qj be the formula 
->K 2 K 1 -i(-ip* A ^(K 2 K 1 ) : >p*, where (K 2 K 1 ) j is an abbreviation for j repetitions of K 2 K 1 . 
Intuitively, qj is true at a state if there is a path that leads to p* in one KxK^step and leads to 
-ip* in an other j-K 1 K 2 steps. Let r\ be q\ and let r J+ i be A ->ri A . . . ->rj. Clearly the 
formulas Tj are clearly mutually exclusive. In a 2 , we replace ->p A q by r\, replace p A ->q by 
r 2 , replace r A ->p A ->q by r 3 , and replace ->r A ->p A ->g by r 4 (so that -ip A ->g is replaced by 
r 3 V r 4 ). In ai, we replace p A g by -i(ri V r 2 V r 3 V r 4 ). The translation is the same, except that 
now the translation for R(x, y) uses r 3 instead of r A ->q A ->g, and the translation for ->R(x, y) 
uses r 4 . With these changes, the proof of the analogue of Lemma A. 10 follows with essentially 
no change. To prove the analogue of Lemma A. 9, we need to construct the analogue of the 
Kripke structure M N . The construction is essentially the same as that given above, except we 
need to add extra states to ensure that the appropriate formulas r 3 - holds. For example, we want 
to make sure that either r 3 or r 4 holds at all states in D N x D N , so we need to add extra states 
to ensure that from each state m x Dn the appropriate path exists. At each state in Dn 
we ensure that r-j holds for some j > 5 and that r-j holds at some state in for each j > 5. 
We then replace the surjection L from $ — {p, q, r} to D N by a surjection from {r 5 , r 6 , . . .} to 
D N . We leave details to the reader. 

The argument in the case that e ^ C proceeds along similar lines. If t ^ C, we use the 
same formulas as above, but replace K 2 K\ by K.lfteC,a slightly different set of formulas 
must be used; see [Halpern 1995] for details. I 

Theorem 5.3: The validity problem for the language C\' K ($, X) with respect to the structures 
in Mi ($, X) for C D {e} is decidable. 

Proof: First, consider the case C = {r, e, t}. We use ideas originally due to Fine [1969]. The 
technical details follow closely the decidability proof given by Engelhardt, van der Meyden, 
and Su [2003] for the case where the semantics is given using semantic valuations rather than 
syntactic valuations. The proof proceeds by an elimination of quantifiers. Following Fine 
[1969], we say that a world w in a structure M is describable by a sentence (p is (M, w) |= ip 
and for all worlds w', if (M, w) \= (p, then for all sentences ip, (M, w) |= ip iff (M, w') |= ip. 
A world is describable if it is describable by some formula (p. 

Let describable ((p) be an abbreviation for 

-^K^ip A -i3y(^K^((p Ay) A ->K-i((p A 

Intuitively, describable(ip) is satisfiable in a structure iff there is a world in the structure de- 
scribable by ip. Let Ckp) be the formula that is satisfiable in a structure M iff there are at least k 
distinct describable worlds where ip is true that the agent considers possible, where two worlds 
are distinct if they disagree on the truth value of at least one formula. That is, for k > 1 is 
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an abbreviation for 



zbi . . . 3xk(/\\<i<j<k^K(xi ^ Xj) A Ai =1 (describable(xi) A ~^K^(xi A </?))) 

Let be an abbreviation for C^p A — iCfc+i^?. Note that E^p is satisfied in a structure M 
where the /C relation is universal iff there are exactly k distinct describable worlds where p is 
true. 

With semantic valuations, it is not hard to show that ->K->p Cip is valid. But this is not 
the case if we use syntactic valuations. For example, let M = (W, /C, ir) be the structure where 
/C is universal and for each of the (uncountably many) truth assignments v to the countably 
infinite set of primitive propositions in $, there is a unique world w v where ir(w v ) = v. Each of 
these worlds is clearly distinct. Since there are only countably many formulas and uncountably 
many worlds, there must be uncountably many undescribable worlds in this structure. (In fact, 
a symmetry argument shows that in this structure no world is describable.) Thus, we need to 
distinguish structures where p is satisfiable but none of the worlds in which ip is satisfiable is 
describable, and structures where ip is not satisfiable. (Both types of structures satisfy -iCi</?.) 
Let E^p be an abbreviation for -iK-xp A -C\*p) and let E (p be an abbreviation for K-xp. 
(Note that K-np =>- ~^C\p is valid.) It is not hard to show that if E^p is satisfied in a structure 
M, then there are actually infinitely many distinct worlds at which ip is true (although none of 
them is describable). Finally, if I ^ oo, let M^ N p be an abbreviation for E t p if I < N and for 
dp ifl>N. 

Let p = (pi, . . . ,p m ) be a vector of primitive propositions and propositional variables. 
Define a point atom for p to be a formula of the form l± A . . .l m where each l { is either or 
-ipi. Let PA(p) denote the set of point atoms of p. Given a point atom a for p and a number 
N, define an N -bounded count of a to be a formula of the form E t a where I < N or I = oo, or 
C N a. Define a (p, A;) -atom to be a formula of the form 

a A A beP A(p)C b , 

where a is a point atom for p and c b is an 2 fc -bounded count of b for each b e PA(p), such that 
c a is not E a. We write At(p,k) for the set of (p, A;)-atoms. These atoms have the following 
properties. 

Lemma A.ll: 

(a) If A, A' e At(p, k) are distinct atoms, then M[' e,t \= ->(A A A'). 

(b) MT* h VAtAt( P ,k)A- 

(c) If A, A' e At(p,k), then either M?'* \= A -^K^A' or M r { e,t h A => K ^ A '- 
Moreover, we can effectively decide which holds. 

(d) If A G At(p, k + 1) and B e At(p ■ x, k) where x does not occur in p, then either 
M. r { e,t |= A =>- 3xB or M. r { e,t |= A SxB. Moreover, we can effectively decide 
which holds. 
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Proof: For part (a), note that if A and A' are distinct (p, /c)-atoms, then either they differ in 
their point atom or they differ in the counting of some point atom. Therefore, it easily follows 
that Mi^ |= ->(AA A'). For part (b), note that in each world in a structure M e , 
exactly one point atom is true, and for each point atom, exactly one 2 fc -bounded count holds. 
For part (c), it can be easily checked that M^' 1 |= A =>- ->K-iA' iff A and A' agree on all the 
conjuncts that are 2 fc -bounded counts of some atom in PA(p) and that if a' is the point atom in 
A', 2 fe -bounded count of a' (in both A and A') is not E a'. Otherwise, it is easy to check that 

M r { e,t h A K ^ A '- 

For part (d), suppose that A is a (p, k + l)-atom and B is a (p • x, /c)-atom. Define an 
x-partition of a 2 fc+1 -bounded count c b of an atom b e PA(p) to be a formula of the form 
e + A e~, where e + is a 2 fc -bounded count of b A x, e~ is a 2 fc -bounded count of b A -ix, and the 
following constraints are satisfied: 

1. if c b = E t b for I ^ oo, then e + = M l+ 2 k(b A x) and e~ = M t _ 2 k{b A -ix) where 
Z+ + 1- = /; 

2. if c b = C 2 k+ib, then 

C 2 fc(& A -ix), or 

(6 A ->x) where Z_ < 2 k , or 
C 2 fc(5 A -ix) where l + < 2 k ; 

3. if c b = E^b, then e + = -Eoo(& A x) and e~ = -Eqo(& A -ix). 

We claim that if e + A e _ is an x-partition of c b , then A^i 6 '* |= c b ^> 3x(e + A e~). To see 
that, first suppose that c b = E\b for I ^ oo. Then we can suppose without loss of generality 
that M \= c b , so that b is satisfiable in exactly I describable worlds. Let <£>!,...,<# be the 
formulas describing these worlds, and let (p = v't^j. It is easy to see that M r { e,t |= c b ^> 
(e + A e~) [x/</?], as desired. Essentially the same argument works if c b = C 2 k+ib except that we 
replace I by 2 k+l and, in addition, we replace l + in the definition of ip by 2 k in case (a); replace 
1+ by Z_ and substituting x for -up instead of p in case (b). (No further changes are needed 
in case (c).) If c b = E^b, then b is satisfied at infinitely many distinct worlds, none of which 
are describable. Thus, there must exist some formula x such that both b A x and b A -ix are 
satisfiable. Moreover, each of them must be satisfied in infinitely many distinct worlds, none of 
which are describable. For if, say, b A x were satisfied in only finitely many distinct worlds, it is 
easy to show that each of these worlds are describable, from which it follows that b is satisfied 
in some describable world. 

A similar argument shows that if e + ^ E (bAx), then M^' 1 1= bAc b =^ 3x(6AxAe + Ae~), 
and if ^ E (b A ->x), then M r { e ' 1 1= b A c b =3- 3x(b A ->x A e + A e~). Conversely, a simple 
counting argument shows that if e + is a 2 fc -bounded count of b A x, e~ is a 2 fe -bounded count 
of b A -ix, and e + A e~ is not an x partition of c b , then Ai r { e ' 1 \= c b =^ -i3x(e + A e~). 

We can assume that A has the form a A A beP A( p )C b , while B has the form a' A A beP A( p ) (c£ A 
c^), where is a 2 fc -bounded count of b A x and is a 2 fc -bounded count of b A -ix. We say 



(a) e + = C 2 fc (b A x) and e~ = 

(b) e + = C 2 fc (b A x) and e~ = 

(c) e + = E i+ (b A x) and e~ = 
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that B is x-compatible with A if either a' = a A x and c+ ^ E (a A x), or a' = a A ->x and 
c~ 7^ E (a A -ix), and moreover, for all point atoms b G PA(p), we have that A is an 
x -partition of c b . Thus, if B is x-compatible with A, it follows from the observations of the 
previous paragraph that 

M r,e,t 3x ( a > A c + A c -) A A b6CfM(p _ {a})) 3x(c+ A c^). 

We now show that 

M r { e,t |= (Ma A c+ A c-) A A be{PA{p) _ {a}) 3x(cZ A c b )) 3x5. 

Suppose that (M, w, V) |= Eta (a' A c+ A c~) A A be (p J 4( p )_{ a })3a;(c^ A c^) for some M G 
^r, e ,t ^hen (M, w, V) |= (a' A c+ A c~)[x/</? a ] for some formula quantifier-free sentence 
(^ a . Similarly, for every b G PA(p) — {a}, there exists a quantifier-free sentence (p b such that 
{M,w, V) |= (c^ A c^)[x/</?b]. Note that, for each point atom c G iM(p), we can replace 
the formulas </? c with any formula ^ that agrees with tp c on c. That is, if M |= (a A y? a ) <^ 
(a A ip a ), then (M, w.V) |= (a' A c+ A c~)[x/^ a ]; similarly, if M |= (6 A <p 6 ) <S> (6A Vb)> then 
(M,w, V) |= c^" A c^x/^]. Let *0 = V ce p^( p )(c A </? c ). It is easy to see that ip agrees with 
each of the formulas (p c on c. It follows that 

(M,w,V) |= (a' A c+ A c~)[x/il>] A A 6e(PA(p) _ {a}) (c+ A c b )[x/^\. 

Note that ip may mention variables, since the point atoms in PA(p) may mention variables. 
(Recall that {p} may include propositional variables.) However, let ip' be the sentence that 
results by replacing each variable y in ip by V(y). Clearly ip' is a quantifier-free sentence, and 
it is easy to see that 

(M,w, V) h (a A c+ A c-)[x/^'] A A be(PA(p y {a}) (c+ A Ofx/^']. 

Thus, (M, w) \= 3x5, as desired. It follows that if B is x-compatible with A, then Ai r { e,t |= 
A =>- 3x5. 

On the other hand, suppose that B is not x-compatible with A. Then we have that either 
(1) a' is not of the form a A x or a A ->x; (2) a 1 is of the form a Ax but c+ = 5 (a A x); (3) a' 
is of the form a A ->x but c~ = E (a A ->x); or (4) there exists a point atom b such that o[ A c b 
is not an x-partition of c b . In each case, it is immediate that Mi e,t \= A ^ ->3xB. | 

Let C\' K (p, k) consist of all formulas in C\ ,K (p) with depth of quantification at most k. 
For a formula tp G C\' K {p, k), let At(p, k, tp) — {A e At{p, k) : A^' 6 '* |= A =>- ^}. 

Lemma A.12: For all p G £^(p, fc), At(p, fc) = At(p, k, tp) U At(p, k, -xp). Moreover, the 
sets At(p, k, ip) and At(p, k, -up) are effectively computable. 

Proof: We proceed by induction on k with a subinduction on the structure of (p. For all k, the 
statement is immediate if p is a primitive proposition or propositional variable in {p}, and the 
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result follows easily from the induction hypothesis if ip is of the form -xp' or of the form ipiAip 2 . 
If (p is of the form Kip' , by Lemma A. 1 1(c), we can effectively compute the set At(p, k, K-*B) 
for each (p, fc)-atom B. It is easy to see that M'{ e,t \= A =>• Kp iff M r { e,t \= A =>• K^B 
for all B E At(p, k, -xp'). Thus, At(p, k, Kip') = r) BeA t( P ,k^<p')At(p, k, K->B). More- 
over, if M r { e * \= A =>• -,K-iB for some B E At(p, k, -xp 1 ), then M r { e ' 1 \= A ^Kip'. 
Thus, At(p, k, -*Kip') D UBeAt(p,k,^tp')At(p,k,^K^B). It follows from Lemma A. 11(c) 
that U BeA t( P ,k,^')At(p,k,^K^B) = r\ Be At( P ,k,^')At(p,k, K^B) = At(p,k, Kip'). Since 
At(p, k, -<Kip') and At(p, k, Kip') are clearly disjoint, it follows that 

At(p, k, -iKtp') = U B eM(p,k,-^/)At(p, k, -1K-1B), 

and that both At(p, k, Kip') and At(p, k, ^Kip') are effectively computable. Finally, if ip — 
Vxip', similar arguments using Lemma A. 11(d) show that At(p, k,\/xp') = r\ Be At( P ,k-i,^<p')At(p, k— 
1, V-<B)(= n SeAt(Pife _i ) ^/)^(p, fc-1, ~^3xB) and At(p, k, -^Jxp') = U BeA t( P ,k-i,^')At(p, k- 
1, -1V-1.B). Again, by Lemma A. 1 1(d), these sets are effectively computable. | 

To complete the proof of Theorem 5.3 for the case C = {r, e, t}, suppose that p e 
£^($,A'). Then there exists some finite p such that ip e £i'^(p). We claim that y9 is 
valid iff At(p, A;, </?) = Ai(p, k). The fact that is valid if At(p, k, ip) = At(p, k) follows 
immediately from Lemma A. 1 1(b). For the converse, note that if At(p, k, ip) ^ At(p, k), then 
by Lemma A. 12, At(p, k, -xp) ^ 0. It is easy to see that each atom in At(p, k) is satisfiable 
in some structure in M r { e ' 1 . If M is a structure in M.^' 1 satisfying A e At(p, k, -xp), then 
M also satisfies -xp, showing that p is not valid. Finally, by Lemma A. 12, we can effectively 
compute At(p, k, p) and check if At(p, k, ip) = At(p, k). 

Thus, we have dealt with the case that C = {r, e, t}. It is well known [Fagin, Halpern, 
Moses, and Vardi 1995, Lemma 3.1.5] and easy to show that a reflexive Euclidean relation is 
transitive. Thus, Ai^ r ' e '^ = M.^ r,e ^ , so we have also dealt with the case that C = {r, e}. 

For the case C = {e,t}, essentially the same proof works. We briefly list the required 
modifications: 

• We define a formula indist that is true if a world indistinguishable from the current 
world (in the sense that the same formulas are true in both worlds) is considered possible. 
indist is an abbreviation for: 

3x(describable(x) A Vy(y 44> ->K->{x A y))). 

Note that indist is guaranteed to hold in a world where the accessibility relation is re- 
flexive. 

• We modify the definition of (p, A;) -atom. We define a (p, /c)-atom to to include a conjunct 
saying whether indist holds. Thus, we define a (p, £;)-atom to have one of the following 
forms: 

- a A indist A /\bePA( P )Cb, where c a ^ E a; or 
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- a A -lindist A /\bePA(p)Cb- 

Note that a A -lindist A E a is satisfiable in M^ e ' l \ since the accessibility relation no 
longer needs to be reflexive, but a A indist A E a is not. 

• We replace M r ' e,t by M e,t throughout the statement and proof of Lemma A.l 1. 

• In the proof of Lemma A. 1 1(c), we have J\A e -y \= A =>- K->A' not only in the case that A 
and A' disagree on the 2 fc -bounded count of some atom in PA(p), but also if -^indist is 
one of the conjuncts of A'. This is true since all structures in A4 e , and hence in A4 e ' f , the 
/C relations satisfy secondary reflexivity: if M = (S, /C, ir) e M. e and (s, £) G /C, then it 
is easy to check that (t, t) e /C. Thus, indist holds at t. 

• In the proof of Lemma A. 11(d), we modify the definition of ^-compatibility. We now 
say that B is re-compatible with A if either 

(a) indist is a conjunct of both A and B, and all the previous conditions for ^-compatibility 
hold; or 

(b) -^indist is a conjunct of both A and B, and all the preivous conditions for x- 
compatibilty hold except that we do not require that c+ ^ E (a A x) or c~ 7^ 
E (a A -ix). 

It is easy to show that M^ e,t ^ |= A =>- 3x5 if 5 is re-compatible with A and that 
^{e,t} | = £ -,3^5 jf 5 j s no t ^-compatible with A. 

The argument for the case C = {e} is similar to that for C = {e, t}. It depends on the fol- 
lowing semantics characterization of satisfiability with respect to structures in AA\, similar in 
spirit to corresponding characterizations for M\ et and M. [ st (see [Fagin, Halpern, Moses, and 
Vardi 1995, Proposition 3.1.6]): A formula is satisfiable in M.\ iff there exists some structure 
M such that (M, s ) h where M = ({ s o} U S U S', vr, JC), and (a) 5 and S' are disjoint sets 
of states; (b) if S = then 5' = 0, (c) /C(s ) = 5; (d) /C(s) = 5 U 5' if s e S U S'; and (e) 
|{s } U ^ U S"| < 1^1 [Halpern and Rego 2006a]. 

Given this characterization, it can be seen that for each point atom b we must count not 
only the number of describable worlds where b is true that an agent considers possible, but also 
the number of describable worlds that an agent considers possible that he considers possible. 
Define indist KK , iV-bounded KK-coxmt, Cj? K ip, and E^ K ip by replacing every occurrence of 
K by KK in the definitions of indist, iV-bounded count, CVy?, and E^ip, respectively. Since 
the K, relation in structures in M.\ satisfies secondary reflexivity and the Euclidean property, it 
is easy to check that M\ \= indist =^ indist KK , M\ |= E^ -*Eq K (p, M\ |= E k tp =^ 
Cf V and M\ |= C NV => C% K ip. 

We now modify the definition of (p, /c)-atom to include a description of what is true at 
the worlds that an agent considers possible that he considers possible. Thus, we now take a 
(p, A;)-atom to have the form 
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• a A indist A indist KK /\bePA( P ) (o> A cf K ), 

• a A ^indist A indist KK AbePA( P ) (o> A C ^ K \ or 

• a A -^indist A ~^indist KK AbePA{ P ) (o> A cf x ), 

where (a) q> (resp., cf x ) is a 2 fc -bounded count (resp., fTif-count) for all b E PA(p), (b) 
c a 7^ -Eoa if indist is a conjunct, (c) c£ K ^ E^ K a if indist KK is a conjunct, (d) if q, = 
and Z < 2 k , then either cf K = Ef n K b and Z < m < oo, or cf x = <^ x 6, (e) if q, = ^6, then 
cf * ^ E XK 6, and (f) if c b = C 2 k b, then cf x = C 2 ^6. 

The same ideas used to prove Lemma A.l 1 for the case of C — {r, e, t} can now be used 
to prove an analogous result for the case C = {e}; we omit details here. The rest of the proof 
is identical to that of the case C = {r, e, t}, replacing every occurrence of M.^' 1 by M\. I 
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